Pandas Profiling Report

Dataset statistics

Number of variables	10
Number of observations	4238
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	314.6 KiB
Average record size in memory	76.0 B

Variable types

NUM	8
CAT	1
DATE	1

Reproduction

Analysis started	2020-08-15 15:57:13.815784
Analysis finished	2020-08-15 15:57:49.040155
Duration	35.22 seconds
Version	pandas-profiling v2.8.0
Command line	`pandas_profiling --config_file config.yaml [YOUR_FILE.csv]`
Download configuration	config.yaml

Warnings

`Death` is highly correlated with `Total` and 1 other fields	High correlation
`Total` is highly correlated with `Death` and 1 other fields	High correlation
`Cured` is highly correlated with `Total` and 1 other fields	High correlation
`New recovered` is highly correlated with `New cases`	High correlation
`New cases` is highly correlated with `New recovered`	High correlation
`Death` has 1435 (33.9%) zeros	Zeros
`Cured` has 611 (14.4%) zeros	Zeros
`New cases` has 1151 (27.2%) zeros	Zeros
`New deaths` has 2703 (63.8%) zeros	Zeros
`New recovered` has 1735 (40.9%) zeros	Zeros

Date
Date

Distinct count	173
Unique (%)	4.1%
Missing	0
Missing (%)	0.0%
Memory size	33.1 KiB

Minimum	2020-01-30 00:00:00
Maximum	2020-07-25 00:00:00

Histogram

Histogram

State
Categorical

Distinct count	39
Unique (%)	0.9%
Missing	0
Missing (%)	0.0%
Memory size	16.6 KiB

Kerala	173
Delhi	141
Uttar Pradesh	139
Haryana	139
Rajasthan	139
Other values (34)	3507

Common Values
Length

Value	Count	Frequency (%)
Kerala	173	4.1%
Delhi	141	3.3%
Uttar Pradesh	139	3.3%
Haryana	139	3.3%
Rajasthan	139	3.3%
Tamil Nadu	136	3.2%
Maharashtra	134	3.2%
Punjab	134	3.2%
Karnataka	134	3.2%
Andhra Pradesh	131	3.1%
Other values (29)	2838	67.0%

Length

Max length	40
Median length	9
Mean length	10.36479471
Min length	3

Latitude
Real number (ℝ_≥0)

Distinct count	35
Unique (%)	0.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	23.171111986786226
Minimum	10.8505
Maximum	34.2996
Zeros	0
Zeros (%)	0.0%
Memory size	33.1 KiB

Quantile statistics

Minimum	10.8505
5-th percentile	11.1271
Q1	18.1124
median	23.6102
Q3	28.218
95-th percentile	33.7782
Maximum	34.2996
Range	23.4491
Interquartile range (IQR)	10.1056

Descriptive statistics

Standard deviation	6.653720329
Coefficient of variation (CV)	0.2871558487
Kurtosis	-0.8019090539
Mean	23.17111199
Median Absolute Deviation (MAD)	5.0939
Skewness	-0.359188359
Sum	98199.1726
Variance	44.27199421

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
10.8505	173	4.1%
18.1124	141	3.3%
28.7041	141	3.3%
27.0238	139	3.3%
29.0588	139	3.3%
26.8467	139	3.3%
34.2996	136	3.2%
11.1271	136	3.2%
31.1471	134	3.2%
15.3173	134	3.2%
Other values (25)	2826	66.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
10.8505	173	4.1%
11.1271	136	3.2%
11.7401	117	2.8%
11.9416	125	2.9%
15.2993	117	2.8%

Value	Count	Frequency (%)
34.2996	136	3.2%
33.7782	134	3.2%
31.1471	134	3.2%
31.1048	122	2.9%
30.7333	124	2.9%

Longitude
Real number (ℝ_≥0)

Distinct count	31
Unique (%)	0.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	81.40560110901369
Minimum	71.1924
Maximum	94.7278
Zeros	0
Zeros (%)	0.0%
Memory size	33.1 KiB

Quantile statistics

Minimum	71.1924
5-th percentile	74.124
Q1	76.2711
median	79.0193
Q3	85.3131
95-th percentile	93.9063
Maximum	94.7278
Range	23.5354
Interquartile range (IQR)	9.042

Descriptive statistics

Standard deviation	6.821608566
Coefficient of variation (CV)	0.08379777893
Kurtosis	-0.8176304814
Mean	81.40560111
Median Absolute Deviation (MAD)	3.3054
Skewness	0.7219177008
Sum	344996.9375
Variance	46.53434342

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
79.0193	269	6.3%
75.7139	268	6.3%
78.6569	258	6.1%
92.9376	229	5.4%
76.2711	173	4.1%
77.1025	141	3.3%
80.9462	139	3.3%
76.0856	139	3.3%
74.2179	139	3.3%
78.2932	136	3.2%
Other values (21)	2347	55.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
71.1924	123	2.9%
73.0169	76	1.8%
74.124	117	2.8%
74.2179	139	3.3%
75.3412	134	3.2%

Value	Count	Frequency (%)
94.7278	109	2.6%
94.5624	56	1.3%
93.9063	119	2.8%
92.9376	229	5.4%
92.6586	117	2.8%

Total
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct count	2175
Unique (%)	51.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	7655.275837659273
Minimum	1
Maximum	357117
Zeros	0
Zeros (%)	0.0%
Memory size	33.1 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	33
median	413.5
Q3	3534
95-th percentile	33963.8
Maximum	357117
Range	357116
Interquartile range (IQR)	3501

Descriptive statistics

Standard deviation	26238.18536
Coefficient of variation (CV)	3.427464394
Kurtosis	64.02940703
Mean	7655.275838
Median Absolute Deviation (MAD)	411.5
Skewness	7.116421348
Sum	32443059
Variance	688442371

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
1	274	6.5%
2	107	2.5%
7	89	2.1%
3	88	2.1%
33	65	1.5%
13	42	1.0%
14	37	0.9%
4	33	0.8%
18	30	0.7%
9	25	0.6%
Other values (2165)	3448	81.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	274	6.5%
2	107	2.5%
3	88	2.1%
4	33	0.8%
5	23	0.5%

Value	Count	Frequency (%)
357117	1	< 0.1%
347502	1	< 0.1%
337607	1	< 0.1%
327031	1	< 0.1%
318695	1	< 0.1%

Death
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct count	685
Unique (%)	16.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	213.98961774421898
Minimum	0
Maximum	13132
Zeros	1435
Zeros (%)	33.9%
Memory size	33.1 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	3
Q3	47.75
95-th percentile	928.6
Maximum	13132
Range	13132
Interquartile range (IQR)	47.75

Descriptive statistics

Standard deviation	931.1634477
Coefficient of variation (CV)	4.351442175
Kurtosis	90.5452801
Mean	213.9896177
Median Absolute Deviation (MAD)	3
Skewness	8.698983116
Sum	906888
Variance	867065.3664

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	1435	33.9%
1	416	9.8%
3	155	3.7%
2	142	3.4%
4	111	2.6%
5	74	1.7%
11	63	1.5%
7	59	1.4%
6	58	1.4%
8	53	1.3%
Other values (675)	1672	39.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1435	33.9%
1	416	9.8%
2	142	3.4%
3	155	3.7%
4	111	2.6%

Value	Count	Frequency (%)
13132	1	< 0.1%
12854	1	< 0.1%
12556	1	< 0.1%
12276	1	< 0.1%
12030	1	< 0.1%

Cured
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct count	1779
Unique (%)	42.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	4414.1998584237845
Minimum	0
Maximum	199967
Zeros	611
Zeros (%)	14.4%
Memory size	33.1 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	5
median	117
Q3	1898
95-th percentile	19912.3
Maximum	199967
Range	199967
Interquartile range (IQR)	1893

Descriptive statistics

Standard deviation	15590.68791
Coefficient of variation (CV)	3.531939741
Kurtosis	56.27588061
Mean	4414.199858
Median Absolute Deviation (MAD)	117
Skewness	6.82804446
Sum	18707379
Variance	243069549.4

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	611	14.4%
1	211	5.0%
2	94	2.2%
3	78	1.8%
33	53	1.3%
7	48	1.1%
10	39	0.9%
5	37	0.9%
11	36	0.8%
6	33	0.8%
Other values (1769)	2998	70.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	611	14.4%
1	211	5.0%
2	94	2.2%
3	78	1.8%
4	31	0.7%

Value	Count	Frequency (%)
199967	1	< 0.1%
194253	1	< 0.1%
187769	1	< 0.1%
182217	1	< 0.1%
175029	1	< 0.1%

New cases
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct count	871
Unique (%)	20.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	310.7720622935347
Minimum	0
Maximum	25297
Zeros	1151
Zeros (%)	27.2%
Memory size	33.1 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	17.5
Q3	158
95-th percentile	1550.6
Maximum	25297
Range	25297
Interquartile range (IQR)	158

Descriptive statistics

Standard deviation	1056.828981
Coefficient of variation (CV)	3.400656332
Kurtosis	115.8952751
Mean	310.7720623
Median Absolute Deviation (MAD)	17.5
Skewness	8.476001987
Sum	1317052
Variance	1116887.496

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	1151	27.2%
1	193	4.6%
2	118	2.8%
3	80	1.9%
4	79	1.9%
5	72	1.7%
6	56	1.3%
7	50	1.2%
8	45	1.1%
10	40	0.9%
Other values (861)	2354	55.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1151	27.2%
1	193	4.6%
2	118	2.8%
3	80	1.9%
4	79	1.9%

Value	Count	Frequency (%)
25297	1	< 0.1%
13894	1	< 0.1%
13438	1	< 0.1%
12399	1	< 0.1%
11923	1	< 0.1%

New deaths
Real number (ℝ)

ZEROS

Distinct count	144
Unique (%)	3.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	7.328456819254365
Minimum	-1
Maximum	1409
Zeros	2703
Zeros (%)	63.8%
Memory size	33.1 KiB

Quantile statistics

Minimum	-1
5-th percentile	0
Q1	0
median	0
Q3	2
95-th percentile	32
Maximum	1409
Range	1410
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	36.63183242
Coefficient of variation (CV)	4.998573823
Kurtosis	567.3802861
Mean	7.328456819
Median Absolute Deviation (MAD)	0
Skewness	18.6144271
Sum	31058
Variance	1341.891147

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	2703	63.8%
1	353	8.3%
2	166	3.9%
3	107	2.5%
4	79	1.9%
6	76	1.8%
5	67	1.6%
9	53	1.3%
8	53	1.3%
7	52	1.2%
Other values (134)	529	12.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-1	2	< 0.1%
0	2703	63.8%
1	353	8.3%
2	166	3.9%
3	107	2.5%

Value	Count	Frequency (%)
1409	1	< 0.1%
668	1	< 0.1%
518	1	< 0.1%
493	1	< 0.1%
443	1	< 0.1%

New recovered
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct count	724
Unique (%)	17.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	197.35889570552146
Minimum	-1
Maximum	13050
Zeros	1735
Zeros (%)	40.9%
Memory size	33.1 KiB

Quantile statistics

Minimum	-1
5-th percentile	0
Q1	0
median	4
Q3	82.75
95-th percentile	933.75
Maximum	13050
Range	13051
Interquartile range (IQR)	82.75

Descriptive statistics

Standard deviation	712.3651874
Coefficient of variation (CV)	3.60949115
Kurtosis	77.19638963
Mean	197.3588957
Median Absolute Deviation (MAD)	4
Skewness	7.530101714
Sum	836407
Variance	507464.1603

Histogram

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	1735	40.9%
1	157	3.7%
2	102	2.4%
3	83	2.0%
4	77	1.8%
7	54	1.3%
5	51	1.2%
10	40	0.9%
8	39	0.9%
6	33	0.8%
Other values (714)	1867	44.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-1	3	0.1%
0	1735	40.9%
1	157	3.7%
2	102	2.4%
3	83	2.0%

Value	Count	Frequency (%)
13050	1	< 0.1%
11546	1	< 0.1%
8381	1	< 0.1%
8018	1	< 0.1%
7725	1	< 0.1%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

First rows

	Date	State	Latitude	Longitude	Total	New cases
0	2020-01-30	Kerala	10.8505	76.2711	1	0
1	2020-01-31	Kerala	10.8505	76.2711	1	0
2	2020-02-01	Kerala	10.8505	76.2711	2	1
3	2020-02-02	Kerala	10.8505	76.2711	3	1
4	2020-02-03	Kerala	10.8505	76.2711	3	0
5	2020-02-04	Kerala	10.8505	76.2711	3	0
6	2020-02-05	Kerala	10.8505	76.2711	3	0
7	2020-02-06	Kerala	10.8505	76.2711	3	0
8	2020-02-07	Kerala	10.8505	76.2711	3	0
9	2020-02-08	Kerala	10.8505	76.2711	3	0

Last rows

	Date	State	Latitude	Longitude	Total	Death	Cured	New cases	New deaths	New recovered
4228	2020-07-25	Odisha	20.9517	85.0985	22693	120	15201	1594	6	808
4229	2020-07-25	Puducherry	11.9416	79.8083	2515	35	1483	95	1	83
4230	2020-07-25	Punjab	31.1471	75.3412	12216	282	8096	477	5	355
4231	2020-07-25	Rajasthan	27.0238	74.2179	34178	602	24547	958	8	732
4232	2020-07-25	Sikkim	27.5330	88.5122	477	0	142	17	0	20
4233	2020-07-25	Tamil Nadu	11.1271	78.6569	199749	3320	143297	6785	88	6504
4234	2020-07-25	Telangana	18.1124	79.0193	52466	455	40334	1640	8	1007
4235	2020-07-25	Tripura	23.9408	91.9882	3759	11	2131	103	1	59
4236	2020-07-25	Uttar Pradesh	26.8467	80.9462	60771	1348	37712	2667	59	1909
4237	2020-07-25	Uttarakhand	30.0668	79.0193	5445	60	3399	0	0	0

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows